Papers with unsupervised contrastive pre-training
DMRetriever: A Family of Models for Improved Text Retrieval in Disaster Management (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models fail to handle the varied search intents inherent to disaster management scenarios, resulting in inconsistent and unreliable performance. |
| Approach: | They propose a new series of dense retrieval models tailored for disaster management that train on a three-stage framework with unsupervised contrastive pre-training and difficulty-aware progressive instruction fine-tuning. |
| Outcome: | The proposed model outperforms baseline models by 13.3 times and 33 times over baselines with only 7.6% of their parameters. |